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LOOP INSTRUCTION PROCESSING USING 



LOOP BUFFER IN A DATA PROCESSING DEVICE 



Background of the Invention 



1. Technical Field 

The present invention relates to processing of loop instructions in a data 
processing device, specifically processing loop instructions using a loop buffer in a data 
processing device having a CPU and a coprocessor. 

2. Discussion of Related Art 

In a conventional data processing device having a CPU and a coprocessor, the 
CPU fetches instructions stored in main program memory for execution by the CPU 
and/or the coprocessor. Coprocessor instructions are decoded by the CPU and if the 
decode indicates a coprocessor operation, the CPU signals to the coprocessor to decode 
the coprocessor instruction for execution. Coprocessors are often used for digital signal 
processing (DSP) wherein arithmetic calculations (e.g., multiplying, accumulating, 
dividing, etc.) are frequently encountered. Although dedicated circuits such as 
multipliers, dividers, or accumulators can be used to perform arithmetic calculations, 
software arithmetic routines are preferred for various reasons including less space 
requirements and costs. CPUs can process the arithmetic software routines, but 
coprocessors are often employed to more efficiently handle the arithmetic routines. 



Typically, arithmetic routines include many repeated data shifting and thus looping 
operations. Instructions within a loop routine are fetched by the CPU from the program 
memory for execution and the same instructions are fetched and executed in subsequent 
iterations, e.g., a block of instructions for performing a division is looped or reiterated 
several times for successive division operations. When a data processing device having a 
CPU and a coprocessor encounters numerous loop operations, the performance of the 
data processing device is degraded in terms of speed because of increased overhead on 
the CPU to process the branch, interrupt, or exception instructions. For example, the 
CPU or the coprocessor must keep track of where the processing routine is before a 
O 10 branch so that the routine can continue upon return from the branch. A separate stack 

pointer is commonly used by the CPU to handle the execution routines. Further, more 
power is consumed because of the frequent access of instructions from the main program 
h| memory. 

O A need therefore exists for a data processing device having a CPU and a 

m 

fU 15 coprocessor for effectively handling loop operations while reducing CPU overhead and 



m 



power consumption of the processing device. 

SUMMARY OF THE INVENTION 

A method of processing loop instructions using a data processing device having a 
central processing unit (CPU) and a coprocessor is provided, wherein the CPU fetches 
20 and decodes instructions retrieved from program memory and determines whether the 

instructions are CPU-type or coprocessor-type, comprising the steps of: decoding 
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the coprocessor instructions by the coprocessor and if a loop operation is decoded, 
retrieving from the program memory the instructions within the loop; storing the 
retrieved instructions within the loop in a loop buffer; and inhibiting instruction fetch 
from the program memory while instructions within the loop are executed in a 
5 subsequent iteration of the loop. Preferably, the method includes the step of accessing 

the instructions within the loop from the loop buffer in a subsequent iteration of the loop, 
and the step of decoding further includes determining a backward branch distance for use 
by the CPU to control branching to and from the loop. 

According to an aspect of the invention, the coprocessor determines from the loop 
O 10 instruction a number of iterations of the loop operation, decrements the number of 

H iterations upon completion of each loop; and signals to the CPU the completion of the 

loop operation when reaching the end of the number of iterations. 

According to a preferred embodiment of the present invention, the storing step of 



m 
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E 



p the method includes storing 'n' loop instructions in 'm' registers of the loop buffer and 

if! 

Rj 15 addressing the 'm' registers by log 2 m least significant bits (LSBs) of a program counter, 

O which is also used for addressing the program memory, wherein n or m is any natural 

number and n is less than or equal to m. Further, accessing of the instructions stored in 
the loop buffer are through a multiplexer and the multiplexer output is controlled by the 
log 2 m LSBs of the program counter. A first instruction within the loop may be stored in 
20 any of the m registers addressed by the LSBs of the program counter. 

The method preferably further including the steps of signaling the presence or 
absence of an active loop instruction by a loop buffer flag in each of the 'm' registers in 
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the loop buffer, the presence of an active instruction in a register is indicated by a 
preassigned signal in the loop buffer flag. 

The method further includes the step of inhibiting instruction fetch from the 
program memory when the preassigned signal in the loop buffer flag is read and indicates 
the presence of an active loop instruction. 

A data processing device is also provided which comprises: a central processing 
unit (CPU) for fetching instructions from a program memory, decoding the instructions 
and sending a signal (CCLK) to a coprocessor if a coprocessor type instruction is 
decoded; a coprocessor for decoding the coprocessor-type instructions upon receipt of the 
signal (CCLK); and a loop buffer for receiving from the program memory instructions 
within a loop and storing the instructions within the loop when the coprocessor decodes a 
loop operation from the coprocessor-type instructions, wherein the instructions within the 
loop are retrieved from the loop buffer for execution in a subsequent iteration of the loop, 
and wherein a disable signal is sent to the program memory for inhibiting access of the 
program memory while the instructions within the loop are retrieved from the loop 
buffer. 

The loop buffer preferably includes 'm' registers, each having a corresponding 
loop buffer flag for indicating whether the corresponding register is filled with an 
instruction, wherein the loop buffer flags are accessed by log 2 m LSBs of a program 
counter used for addressing the program memory, and a program memory inhibit signal 
is generated based on a signal read from the loop buffer flag. The loop buffer preferably 



includes 'm' registers and the registers are addressed by log 2 m LSBs of a program 
counter used for addressing the program memory. 

According to a preferred embodiment of the present invention, the coprocessor 
decodes from a loop instruction a loop block size and a number of iterations of looping, 
and calculates a backward branch distance for use by the CPU to control branching to 
and from the loop, wherein the backward branch distance is preferably the loop block 
size minus one. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of a data processing device having a CPU, coprocessor, 
and a loop buffer according to the present invention; 

Fig. 2 illustrates the pipeline operation and loop iterations of the data processor of 

Fig. 1; 

Fig. 3 shows a block diagram of the loop buffer; and 

Fig. 4 shows a representative flow of loop instructions of the loop buffer of Fig. 1 
according to a preferred embodiment of the present invention. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Figure 1 shows a block diagram of a data processing device according to a 
preferred embodiment of the present invention. The data processing device 100 includes 
a central processing unit (CPU) 110 and a coprocessor 120 for executing CPU and 
coprocessor type instructions fetched from main program memory 130. CPU 1 10 fetches 



instructions by providing program address 140 to main program memory 130 to output 
the instructions stored in the addressed locations from main program memory 130. The 
fetched instruction is preferably predecoded by predecoder 1 12 for the presence of a 
coprocessor instruction. The fetched instruction is latched in instruction register latch 
1 13 and decoded by decoder 1 15 of CPU 1 10, and if it is a CPU-type instruction, it is 
executed by operation execution unit 1 17 in CPU 110. If the predecoder 1 12 decodes a 
fetched instruction as a coprocessor-type instruction, predecoder 1 12 outputs an active 
signal (COPI) at line 1 18 to so indicate. The COPI signal is synchronized with the system 
clock (SYSCLK) 1 14 by an AND gate 1 16 to output a (CCLK) clock signal 170. The 
CCLK 170 signal is used to clock in the fetched instruction into a coprocessor instruction 
register latch (COPIRL) 128. Decoder 125 of coprocessor 120 decodes the instruction 
and the coprocessor type instruction is executed by operation execution unit 127 of 
coprocessor 120. 

For purposes of illustrating the advantages of the present invention, the Harvard 
pipelining architecture, which is a four stage pipeline structure of fetch, decode 1, decode 
2, and execute/memory, is employed by the data processing device 100. The pipeline 
structure uses latches which respond to two phases (phase 1, phase 2 0 within one cycle 
of a system clock). A first latch responds to phase 1 and a second latch responds to phase 
2 of the system clock. Memory access and instructions fed from program memory occur 
concurrently in the same clock cycle. 




According to a preferred embodiment of the present invention, a loop buffer 122 
is used to enhance the performance of the data processing device 100. According to the 
present preferred embodiment, the loop buffer 122 is used to store instructions fetched 
from main program memory which are within loop routines for more efficient accessing 
5 and processing by the CPU 110 and/or coprocessor 120. Advantageously, the use of a 

loop buffer relieves the data processing device 100 from having to access the main 
program memory 130 when subsequent iterations of the loop routines are executed. 
Since arithmetic calculations and processing of DSP type instructions frequently involve 
loop routines, the frequency of use of the loop buffer in place of access from main 
Q 10 program memory 130 can be substantial. Since instruction fetch from main program 

2 memory are power consuming operations, the device and process according to the 

Iji 

^ present invention reduces the overall power consumption of the data processing device 

SJ 

jj 100. The loop buffer 122 architecture and operation will be described in further detail 

» 

B below with reference to figure 3. 

L: ; 

fU 1 5 Referring to figure 2, which shows an exemplary pipelining of loop routines 

p according to a preferred embodiment of the present invention. The exemplary routine 

includes a nested loop at program address 104 and 105 and a long loop from program 
address 102 to program address 108. Upon the first detect of a loop instruction by 
decoder 125 of coprocessor 120 (Figure 1), instructions within the loop are stored in loop 
20 buffer 122. The loop block size and the number of iterations of loops are also detected 

by the coprocessor. Coprocessor calculates the loop block size and the timing to issue 
backward branch instructions to signal the CPU to branch to and from the loop routine. 
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According to a preferred embodiment of the present invention, the backward branch 
distance is calculated to be loop block size minus one. It can be seen from figure 2 that 
branch instructions are issued from a coprocessor at an instruction prior to the appearance 
of the last instruction of the loop. For example, if the loop block size is two (for PA=104 
and PA=105), the backward branch is issued at (2 minus 1) or the first instruction of the 
loop. For the loop from PA=102 to PA=108, the backward branch is issued at (9 - 1 = 8) 
the eighth instruction within the loop at PA=107. CPU 1 10 carries out the branch 
operation in response to the branch signal from the coprocessor 120. When a specified 
number 6 n' iterations of the loop have been executed, a branch instruction is not issued, 
allowing the routine to proceed outside of the loop, to PA=109. 

Figure 3 shows the structure and architecture of a loop buffer for use in a data 
processing device according to the present invention. Loop buffer 122 comprises "M" 
buffers (M being any natural number), each having a corresponding loop buffer flag for 
indicating the presence or absence of an active instruction stored in a corresponding latch 
register of the loop buffer 122. Loop buffer 122 is of a sufficient size in length to hold 
the largest block of instructions within a loop routine and the buffers are sufficiently 
wide to hold at least the full width of an instruction. In the present embodiment, the 
buffer width is preferably 32 bits, the number of buffers M is preferably 12 and the loop 
buffer flag (LBF) is preferably one bit each. Upon detection of a loop routine by a 
decoder in the data processing device, which in the present embodiment, the decoding is 
by decoder 125 of coprocessor 120, the instructions within the loop routine are read from 
the main program memory 130 and stored, preferably sequentially, in the coprocessor 



120 in the latches of loop buffer 122. According to a preferred aspect of the present 
invention, the access to and from the loop buffer including the loop buffer flag are 
controlled from log 2 M least significant bits (LSBs) of the program address 140. For 
example, if M is equal to 16, 4 (log 2 16 equal to 4) LSBs of the program address 140 are 
used to write and read into and out of the loop buffer 122 and loop buffer flags 124 . 
According to this embodiment of the invention, the four LSBs of program address 140 
are used to address the M=16 latches of loop buffer 122 and the corresponding 16 bits of 
LBF 124. When a loop routine is detected, the first instruction within the loop routine 
will be loaded from the main program memory 130 into the latch of the loop buffer 122 
addressed by the four LSBs of program address 140. Upon storing an instruction in the 
latch addressed by the four LSBs of program address, the corresponding LBF is written 
with a preassigned signal to indicate the presence or absence of an instruction. 
According to the present embodiment, the setting of the flag with a logic high ( T) 
signals an active instruction in the corresponding latch of loop buffer 122. As the 
subsequent instructions within the loop are read from main program memory 130, they 
are loaded in the latches of loop buffer 120, preferably sequentially, as they are read out 
of main program memory 130 addressed by the four LSBs of program address 140. 

When coprocessor 120 decodes a loop routine, the coprocessor also reads from 
the instructions the pertinent data needed for managing the loop operation. The data 
includes the block size of the loop routine and the number of iterations of the loop. The 
coprocessor 120 monitors the number of instructions within a loop routine to be executed 
by calculating the distance of travel (in clock cycles) of a particular loop. According to 



this embodiment, distance is the loop block size minus one. For example, if the loop 
block size is 9, the loop distance before a backward branch signal is generated is 9 minus 
1 or 8 pipelines. Coprocessor 120 also monitors the number of iterations of the loop 
routines. Upon the first occurrence of a loop routine, the instructions are read from main 
program memory 130 and instructions within the loop are stored in latches of loop buffer 
122 so that the instructions within the loop are executed and read from loop buffer 122 in 
the next iteration of the loop routine, relieving the data processing device from having to 
access the main program memory 130. Coprocessor 120 decrements the count of the 
number of iteration of the same loop by one and this is repeated until the number of 
iterations is counted down to zero, whereupon the loop routine is completed and 
coprocessor 120 signals to CPU 1 10 that the loop is completed. In the present preferred 
embodiment, a branch instruction is not generated at an instruction prior to the end of the 
loop routine (PA=107 of Fig. 2), and the routine continues to the next instruction outside 
of the loop routine (PA=109 of Fig. 2). Advantageously, because the log 2 M bits of 
program address 140 is used for writing and reading the loop buffer 122, there is no need 
for the coprocessor to separately monitor the program address count or to use any stack 
pointers for keeping track of where the program address was before the loop routine. 

Referring again to Figure 3, the latches of loop buffer 122 are shown to be 
addressed by the LSBs of program address 140 for writing the instructions of the loop 
routine fetched from main program memory 130. In the next iteration of the same loop 
routine, the instructions are read out of loop buffer 122, the reading of the instructions 
from the latches of loop buffer 122 are through a'mto T multiplexer 133, with the select 
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port addressed by the 4 LSBs of program address 140. The LBF registers are also read 
through a multiplexer 135 with the same four LSBs of program address 140 used as 
select signals. Thus, when a LBF register signal is read as active, or according to this 
preferred embodiment a logic high, signaling an active instruction within a loop being 
read from loop buffer 122, the active signal is used to select multiplexer 126, which 
multiplexes between the instruction read from either loop buffer 122 or main program 
memory 130. With an active LBF register signal, multiplexer 126 outputs the instruction 
read from loop buffer 122. While the instruction is being read, the active signal of the 
LBF register is also used to disable access of main program memory 130 by outputting 
an active DIS signal from multiplexer 135. The DIS signal is used to inhibit instruction 
fetch from the main program memory. For example, the DIS signal is connected to the 
memory select signal (CAS) to disable access from the main program memory 130. 
Advantageously, the configuration of the loop buffer, the LBF registers, and the 
multiplexers of Figures 1 and 3 reduces access of instructions from main program 
memory 130 when instructions are executed from loop buffer 122. The loop instruction 
output from loop buffer 122 through MUX 126 can be either a coprocessor-type 
instruction for execution by coprocessor 120 or the instruction can be a CPU-type 
instruction executed by CPU 110. If the instruction is a CPU-type instruction, the 
instruction output from multiplexer 126 is forwarded to CPU 1 10 via bus 155. If the 
instruction retrieved from loop buffer 122 is a coprocessor type instruction, the output of 
multiplexer 126 is latched into coprocessor instruction register latch 128, decoded by 
decoder 125 and executed by operation execution unit 127 of coprocessor 120. 
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According to a preferred embodiment of the present invention, the execution of a 
loop routine with use of a loop buffer can be overridden by the CPU in special 
circumstances. The CPU 1 10 can override the loop buffer operation by controlling the 
loop buffer flags, for example, by clearing active signals in the flags. 

Figure 4 is a table listing for illustrating an execution of an exemplary routine 
having loop operations using a loop buffer according to a preferred embodiment of the 
present invention. In this example, a loop routine is encountered at program address 102. 
Since the LSBs of the program counter is used as the loop pointer, the loop pointer points 
at loop buffer latch number two (loop pointer = 2). At the first instruction cycle of the 
loop routine, program address (PA) is at 102 and the loop routine is detected and 
decoded by coprocessor 120. Upon execution of this instruction, which is fetched from 
main program memory 130, the program data is stored in address 2 of loop buffer 122. 
During the next instruction access from program memory 130, at program address 103 
and loop pointer 3, the LBF register bit 2 is set to indicate that an instruction has been 
loaded in address 2 of loop buffer 122. During this pipeline, the instruction just fetched 
from program memory 130 is loaded into location 3 of loop buffer 122. At program 
address 104, coprocessor 120 detects a nested loop which has a loop block size of 2. 
Coprocessor 120 thus calculates the backward branch distance of 2-1 =1 and signals a 
branch instruction in this pipeline. Meanwhile, the instruction fetched from program 
address 104 is stored at the fourth location of loop buffer 122, and the previous addressed 
LBF register at location 3 is set to indicate that an active loop instruction has been stored 
at location 3 of loop buffer 122. At program address 105, the instruction is fetched from 
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program memory 130, CPU 1 10 is alerted to a branch signal by coprocessor 120 and 
prepares branching of the instruction to the nested loop which begins at program address 
104. During the pipeline of program address 105, the instruction fetched from program 
memory 130 is stored in the fifth location of loop buffer 122 and LBF register number 4 
is set to indicate that the fourth location had been stored with the previous loop 
instruction. 

The next instruction is the first occurrence of the nested first iteration of the 
nested loop which begins at 104, and the program instruction is read from the fourth and 
fifth locations of loop buffer 122 for execution. Upon the end of the execution of nested 
loop at instruction cycle 6, coprocessor 120 signals the end of loop or no branch. CPU 
1 10 does not cause a branch and the program address is incremented to the next address 
which is 106. At this time, loop buffer 122 still has active loop instructions at locations 
2, 3, 4 and 5 as indicated by an active signal, or a logic 1 at respective bit positions of 
LBF [8:0]. The pipeline of program address 106 returns fetching of instructions of 
program memory 130 and filling of loop buffer of an instruction at location 6 of the loop 
buffer. According to the present preferred embodiment of the invention, coprocessor 120 
has retrieved the information needed to monitor the beginning and the approach of the 
end of loop routines, e.g., by calculating the backward branch distance and monitoring 
the number of iterations of loops. Thus, at program address equals 108, coprocessor 120 
recognizes that this is the end of the loop routine which began at program address 102. 
During this pipeline, loop buffer latches 7 and 8 are filled with instructions fetched from 
program memory 130 and locations 2 to 8 have now been loaded with the instructions 
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within the loop (from PA 102 to PA 108). The next instruction branches back to PA 102 
to begin the next iteration of the loop. The loop pointer is at 2, and all instructions within 
the loop will be fetched from loop buffer 122 and the entire loop including the nested 
loop at PA 104/105 is repeated. It can be seen that during the execution of the loop from 
PA=102 to PA=108 in this iteration, there is no need to access main program memory 
130. Prior to the last pipeline of the loop routine, a branch signal is generated by 
coprocessor 120 at instruction 17. CPU 1 10 prepares branching out of the loop routine 
and advances PA from 108 to 109, the beginning of a fetch instruction outside of the loop 
routine. At PA 109, the LPF registers are cleared and instructions are fetched from 
program memory 130. PA 109 and PA 1 10 have instructions which are not decoded as 
loop instructions. 

One ordinarily skilled in the art can readily appreciate that the specific 
architecture and implementation of the loop buffer and program memory control as 
described above can be varied without departing from the scope of the present invention. 
For example, loop buffer 122 can be integrated on coprocessor 120, or on a common 
integrated circuit chip, or can be placed external to either coprocessor 120 or CPU 1 10. 
The generation of branch addresses and the monitoring of the number of iterations are 
performed according to the present embodiment by coprocessor 120. These functions 
can also be performed by a memory controller (not shown). It can also be seen that the 
architecture of the embodiment of the invention shown in Fig. 1 facilitates execution of 
instructions stored in the loop buffer which are either coprocessor type or CPU type 
instructions. Accordingly, the invention is not limited to the precise embodiments 
described herein and the gist, scope, and spirit of the invention is defined by the 
appended claims. 
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